An audio-visual approach to measuring discourse synchrony in multimodal conversation data
نویسنده
چکیده
This paper describes recent work on the automatic extraction of visual and audio parameters relating to the detection of synchrony in discourse, and to the modelling of active listening for advanced speech technology. It reports findings based on image processing that reliably identify the strong entrainment between members of a group conversation, and describes techniques for the extraction and analysis of such information.
منابع مشابه
A Multimodal Discourse Analysis of Some Visual Images in the Political Rally Discourse of 2011 Electioneering Campaigns in Southwestern Nigeria
This paper presented a multimodal discourse analysis of some visual images in the political rally discourse of 2011 electioneering campaigns in Southwestern Nigeria. The data comprised purposively selected political visual artefacts from political rallies across the six Southwestern States in Nigeria (Osun, Oyo, Ondo, Ekiti, Ogun, and Lagos). The data were analyzed using Halliday’s (1985) syste...
متن کاملTeachers’ Strategies Used to Foster Teacher-Student and Student-Student Interactions in EFL Conversation Classrooms: A Conversation Analysis Approach
Despite the fact that there are a wide range of strategies used to foster interactions in EFL conversation classrooms, many novice teachers are not aware of them. In view of this problem, the current study aimed to identify such strategies commonly used by EFL teachers in conversation classrooms. To this end, fifty sessions of college level conversation classrooms were observed andtheir teacher...
متن کاملAn Alternative to Low-Level-Synchrony-Based Methods for Speech Detection
Determining whether someone is talking has applications in many areas such as speech recognition, speaker diarization, social robotics, facial expression recognition, and human computer interaction. One popular approach to this problem is audio-visual synchrony detection [10, 21, 12]. A candidate speaker is deemed to be talking if the visual signal around that speaker correlates with the audito...
متن کاملMultimodal Analysis of “well” as a Discourse Marker in Conversation: A Pilot Study
Discourse markers, a group of pragmatic elements, are used widely in our daily communication. Among these markers, well is found to be the most frequently used one in conversation. Although much research has been carried out on its theoretical bases such as its definition, functions and categorizations, few studies have taken a multimodal approach in analyzing this marker. The aim of the presen...
متن کاملClassroom Discourse Analysis as a Tool for Reflective Practice: Focus on Form Approach
The present research aimed at investigating the interaction of the classroom talk to have a better understanding of the teachers’ practice teaching which can pave the way for reflection on teaching. The study benefitted from conversation analytic perspective to qualitatively and interpretively examine the classroom discourse of the teacher-learner interaction. The classroom talk was analyzed th...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009